AR AND MA REPRESENTATION OF PARTIAL 
AUTOCORRELATION FUNCTIONS, WITH APPLICATIONS 

AKIHIKO INOUE 



Abstract. We prove a representation of the partial autocorrelation function 
(PACF), or the Verblunsky coefficients, of a stationary process in terms of the 
AR and MA coefficients. We apply it to show the asymptotic behaviour of the 
PACF. We also propose a new definition of short and long memory in terms 
of the PACF. 



1. Introduction 

Let {X n : n G Z} be a real, zero-mean, weakly stationary process, denned on a 
probability space (f2, J 7 , P) with spectral measure not of finite support, which we 
shall simply call a stationary process. We write {"f n :neZ} for the autocovariance 
function of {X n }: j n :— E[X n Xo] for n E Z. For we have another sequence 

{ a n}^°=o called the partial autocorrelation function (PACF), where ao :— 70, or := 
71/70, and for 11 > 2, a n is the correlation coefficient of the two residuals obtained 
from Xq and X n by regressing on the intermediate values X\, . . . A„_i (see §2 
below). 

The autocovariance function {7^} is positive definite, and the inequalities that 
this positive definiteness imposes may be inconvenient in some contexts. By con- 
trast, the PACF {ttnl^o gi yes an unrestricted parametrization, in that the only 
inequalities restricting the a n are the obvious ones implied by their being correla- 
tion coefficients, i.e., a n E [—1,1], or (—1,1) in the non-degenerate case relevant 
here. This result is due to Barndorff-Nielsen and Schou [BSJ . Ramsey jRaj in the 
time-series context. See also Degerine |Dej . and for extensions to the non-stationary 
case, Degerine and Lambert-Lacroix [PL] . However, in the context of mathemati- 
cal analysis — specifically, the theory of orthogonal polynomials on the unit circle 
(OPUC) — the result dates back to 1935-6 to work of Verblunsky [VlJ|V2], where 
the PACF appears as the sequence of Verblunsky coefficients. For a survey of 
OPUC, see Simon |Si2 , and for a textbook treatment, Si3J (analytic theory), Si4 
(spectral theory). One of our main purposes here is to emphasize the importance 
of the PACF: "This knows everything" , a remark we owe to Yukio Kasahara. 

The question thus arises of a 'dictionary', allowing one to pass between state- 
ments on the covariance {7„ : n S Z}, or the spectral measure fi defined by 
7„ = e lke fi(d9), and the PACF {a„}™ =0 ; see the last paragraph of |Si3j . page 3, 
where this is stated as perhaps "the most central" question in OPUC. A prototype 
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of such a result is Baxter's theorem (see [Ball [Ba2] ; see also Theorem 14.11 below 
and |Si3[ Chapter 5]). Such a link exists, in the shape of the Levinson (or Szego- 
Levinson-Durbin) algorithm, due to Szego [Szj in 1939 (Szego recursion), Levinson 
[L] in 1947, Durbin |Duj in 1960; for a textbook account, see Pourahmadi [P , §7.2. 
For the history of Szego recursion (Theorem 1.5.2 of |Si3j ). see }Si3j , page 69. But 
while very useful numerically, the Levinson algorithm is less suitable for theoretical 
studies, such as one of the questions that motivates us here — the behaviour of the 
PACF for large lags (that is, large n). 

In this paper, to fill the gap above at least partially, we introduce a representation 
of the PACF which is given only in terms of another sequence {/3 n }%=o defined by 



(see Inoue and Kasahara |IK1[ page 8], [IK21 (2.23)]), where the two sequences 
{c n }^Lo an d { a n}%Lo have statistical interpretations as the coefficients of the 
MA(oo) and AR(oo) representations of the process, respectively (see (MA) and 
(AR) below). They also have analytic interpretations as the coefficients in the 
Maclaurin expansions of the Szego function D(z) occurring in the theory of OPUC 
and its associate — 1/D(z), both of which are outer functions in Beurling's sense 
(see §2 below). For background, see Si3 , or — from a statistical point of view — 
Grenander and Szego [GS], Rozanov |Roj . Ibragimov and Rozanov [IR] . 

We are particularly interested in the asymptotics of a n as n — > oo, and the 
representation of a n is useful in investigating them since the representation enables 
us to study a n directly via (3 n or a n and c n . In a number of the specific examples 
of processes with long memory we treat, here and in [12], [E], [IKlj . we observe 
behaviour of the form 

(d/n) a n ^d/n (n — > oo) 

(by the representation of a n , we are able to improve the estimate of this type in (I2"l 
H3l HKlj . where only \a n \ was considered — we were unable to determine its sign). 
In (d/n), and throughout the paper, a n ~ b n as n — > oo means lim n _ >c>0 a n /b n = 1. 
On the one hand, (d/n) seems very special behaviour, if we begin by specifying our 
model via the PACF, since by Verblunsky's theorem any value in (—1, 1) can be 
taken by any a n . On the other hand, it is more usual in practice to specify our model 
with long memory by other means, such as the AR and MA coefficients, and here 
such behaviour seems to be typical of the (quite broad) classes of example where 
one can carry out the computations and obtain an explicit asymptotic expression 
for a„, such as the fractional ARIMA (FARIMA) models studied in [B j HKlj and 
Theorem 12.51 below. In this connection, we note that in recent work of Simon 
[Silj . the case (d/n) is described as 'a prototypical example'. See also |Si3| . |Si4] 
where |Silj is developed further, and the papers by Golinskii and Ibragimov [Glj . 
Damanik and Killip |DK] that inspired it. We note also that a generalization of 
(d/n), in which 'asymptotic to' is replaced by 'of the same order of magnitude as', 
is obtained as the conclusion in work of Ibragimov and Solev [IS] , under conditions 
on the spectral density. 

We denote by H the real Hilbert space spanned by {Xk : k G Z} in L 2 (il, T , P). 
The norm of H is given by \\Y\\ := i^F 2 ] 1 / 2 . For n, m € N with n < m, we denote 
by #[„, m ], ff(-oo,m] and H[ m>0o ) the subspaces of H spanned by {X n ,...,X m }, 



oo 





v=0 
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{Xk : k < m}, and {Xk : k > n}, respectively. The proof of the representation of 
the PACF is based on the approach introduced in [12] which combines von Neu- 
mann's alternating projection theorem (see [Pj Theorem 9.20]) and the following 
intersection of past and future property of {A„}: 

(IPF) #(-cc >n ] n H [lt00 ) = H ll>n] (n= 1,2,...)- 

This approach is also useful in continuous-time models; see Inoue and Nakano |IN| 
and the references therein. A useful sufficient condition for (IPF) is that {X n } 
is purely non-deterministic (PND) (see §2 below) and has spectral density A(-) 
such that J_ n d9/ A(0) < oo (see [12], Theorem 3.1), which itself is a discrete-time 
version of the Seghier-Dym theorem [S] , |Dy| . This theorem itself originates in work 
of Levinson and McKean |LM| . Naturally, (IPF) is closely related to the property 

(CND) ff(-»,o]nff M ={0} 

called complete non- determinism; see Bloomheld et al. |B JH) . In fact, a stationary 
process is completely non-deterministic if and only both (PND) and (IPF) are 
satisfied (see [IK 2] . Theorem 2.3). In particular, if {X n } is PND and has spectral 
density A(-) such that d6/A(6) < oo, then it is CND. 

In §2, we state the main results, including the representation of the PACF and its 
asymptotic behaviour of the type (d/n). Sections 3-5 are devoted to their proofs. 
In §6, we give a further application of the representation, that is, the asymptotics 
for the PACF of processes with regularly varying covariance functions. In §7, we 
close the paper with results for ARMA processes. 

2. Main Results 

As stated in §1, let H be the real Hilbert space spanned by {Xk : k € Z} 
in L 2 (f2, J 7 , P). which has inner product (Yi,!^) := -£'[^1^2] and norm ||Y|| := 
(Y, Y) 1 / 2 . Also, for an interval / C Z, we write Hi for the closed subspace of H 
spanned by {Xk : k E 1} and Hj- for the orthogonal complement of Hi in H. 
Let Pi and Pf be the orthogonal projection operators of H onto Hi and Hj-, 
respectively. Thus Pj~Y = Y — P^Y for Y 6 H . The projection PjY stands for 
the best linear predictor of Y based on the observations {Xk : i € /}, and P^Y for 
its prediction error. 

The partial autocorrelation function (PACF) {a„}^L °f {^n} is defined by 

(PACF) a :=7o, a n :=U n /V n (n = l,2,...), 

where U x := (X U X ), V l := ||Ai|| 2 and 

U n : = (P[i in -i]X n , P^ n _^X ) (n = 2,3, . . .), 

V n : = ll^[i,n-i]^n|| 2 (n = 2, 3, . . . ) 

(cf. Brockwell and Davis [BDl §3.4 and §5.2]). We have V n > for n > 1 
since we have assumed that the spectral measure fj, of {X n } has infinite support; 
Xi, X2, A3, . . . are linearly independent since no nonzero trigonometric polynomial 
vanishes \x a.e. Also, since ||A || = ||Ai|| and HPj^^^AoH = WP^,^^ X n \\ for 
n > 2, a n is actually the correlation coefficient between the residuals Pr[ n —i]Xo 
and Pfx n _i]X n (resp. Ao and X n ) for n > 2 (resp. n = 1). 
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A stationary process {X n } is said to be purely nondeterministic (PND) if 

noo 
ff(-oo,n] = {0} 
n— — oo 

or, equivalently, there exists a positive even and integrable function A(-) on (— 7r, 7t) 
such that 

e m9 A(8)d8 (neZ), / | log A(0)|d0 < oo 

-7T •/ — 7T 

(see [BD] §5.7], [RoJ Chapter II] and [GSj Chapter 10]). We call A(-) the spectral 
density of {A„}. Using A(-), we define the Szego function D(-) by 

D(z) := i -t- [ e \. + * log A(0)dd\ (z € C, \z\ < 1). 

t 4?r e lW - z J 

The function D(z) is an outer function in the Hardy space H 2 of class 2 over the 
unit disk |z| < 1. Using £>(•), we define the MA coefficients c n by 

oo 

D{z)^Y. c ^ n (\ z \< 1 )> 
and the AR coefficients a n by 

oo 

-^ = E«^ n (M<i) 

(see [El §4] and |IK2| §2.2] for background). Both {c n } and {a n } are real sequences, 
and {c„} is in The coefficients c„ and a n are actually those that appear in the 
following MA(oo) and AR(oo) representations, respectively, of {X n } (under suitable 
condition such as {a n } € I 1 for the latter): 

n 

(MA) X n = 

j=— oo 

(AR) a„- 3 l 3 + £„ = (n € Z), 

j=-oo 

where is the innovation process defined by = €fc/||efc|| with ek the prediction 
error when we predict X}~ from the whole past {X m : m < k — 1}, i.e., — 
P± k -i]Xk (cf. [IK21 §2]). From (MA), we have the following equality: 

OO 

(2.1) 7„ = Y c vC\n\+v (n E Z). 

v=a 

We wish to derive a representation of a„ which is given only in terms of /?(•) 
defined by (*). For this purpose, we consider the following two conditions (BC) 
and (0(l/n)): 

(BC) The process {X n } has summable autocovariance function {7™}, i.e., J2°?oo l7n| < 
00, and positive spectral density A(-), i.e., min eg r_ W 7r i A(8) > 0. 
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(0(l/n)) {X n } is PND, and satisfies both \a n \ < oo and 



oo 



(2.2) 



c v a n+v \ = 0(l/n) 



(n — » oo). 



Notice that if {7™} G i 1 , then {A n } has continuous spectral density A(9) = 
( 27r ) _1 E-oo7fce- lfce . We will see (Theorem S3]) that (BC) holds if and only if 
{X n } is PND, {a n } £ I 1 and {c„} € I 1 . We also see that (0(l/ra)) holds for 
many interesting processes including the FAPJMA(p, d, q) processes with < d < 
1/2 which we consider below. The condition (L(d, £)) below imples (0(l/n)) (see 
Proposition 1 5 . 1 1 below) . ARMA processes satisfy both (BC) and (0(l/n)). 

Remarks. 1. Condition (BC) requires that the process have summable autocovari- 
ance and positive spectral density. It could thus be denoted (SP). We call it (BC) 
instead to emphasize its role as Baxter's condition. Baxter's theorem (|Bal, Ba2 ; 
see also Theorem 14. 1 1 below) gives the equivalence of (BC) with summability of the 
PACF (i.e., {a n } € I 1 ) subject only to the very weak condition that the spectral 
measure /x has infinite support. See Chapter 5 of [Si3], where Baxter's theorem is 
discussed in detail and proved. 

2. Several different definitions of short memory (or its negation, long memory) are 
in current use. See for example Section 2 of the survey paper Baillic Bai] for details 
and references. The most standard definition is that {X n } has long memory (resp. 
short memory) if Y^,k=-oo 17*1 = 00 ( res P- < see Beran |Be[ page 6], |BD1 §13.2]. 
The fact that Baxter's theorem is so powerful and useful suggests the possibility of 
using Baxter's condition to define short memory in a new sense: call the process 
short memory if Baxter's condition holds, long memory otherwise. 

3. The difference between these approaches to short and long memory is well illus- 
trated by the fractional APJMA (or FAPJMA) processes (see below for definitions), 
studied in e.g. [HI IIK1| and Theorems 12.41 and 12.51 below. The two main cases 
d € (—1/2,0) and d € (0, 1/2) behave in the same way from the point of view of 
asymptotics of PACF (d/n for each; see Theorem 12.51 below) and prediction error 
(d 2 /n for each; see (|2.24[) below) — but in different ways from the point of view 
of summability of the autocovariance function. Our contention is that the PACF 
{«„}, and/or the prediction error {S(n)}, are more informative about the essence 
of long-range dependence — the rate at which the information in the remote past 
decays with time — than the autocovariance function {7^} which is usually used 
here. 

4. Wu [W] , §3 considers stationary processes which satisfy {7,1} ^ I 1 (long-range 
dependence) but have lim^^oo Ylk=-K 7(^)- uses ^ ne Zygmund class of slowly 
varying functions; see Bingham et al. |BGT| §1.5.3], Zygmund [21 V.2]. 



Under (BC) or (0(l/n)), we define, for n = 0, 1, . . . , 



(2.3) 



di (n) 



0(n) 



OO 



(2.4) 




mi— 
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and, for k = 3, 4, . . . , 

oo oo 

dk(n) = ^2 P(m k -i+n) ^ P(™>k-i + m fc-2 + n) 

m j- _ i =0 mi._o— 

2.5 

v 7 CO oo 

■ • • P{fn^ + m 2 + n) Pirn? + m\ + n)/3(m 1 4 

m2=0 mi— 



the sums converging absolutely (see Proposition 14.31 below). 
Here is the representation of the PACF {a„}. 

Theorem 2.1. We assume either (BC) or (0(l/n)). Then, for n = 1, 2, . . . , 

o X ^OO 

(2.6) [/„ = ( Co ) 2 V dafc-ifr), 

* — * k—1 

(2-7) K = (co) 2 {l + ^ =i d 2fc (n)}, 

C9 « - E^i rf 2fc-i(n) 

(2.8) a n - oo — , 

all the sums converging absolutely. 

If {X n } is PND, then V n | ll^oo,-!] A || 2 = (c ) 2 , whence a„ = C/„/14 ~ 
(co)~ 2 U n , as n — ► oo (see [I2l §2]). Thus an immediate consequence of Theorem l2.ll 
is the next corollary. 

Corollary 2.2. We assume either (BC) or (0(l/n)). T/ien, 

oo 

(2.9) a„~^d 2fc _i(n) ( n — > oo). 

fe=i 

We turn to the results on the asymptotic behaviour of a n as n — > oo. We 
write IZo for the class of slowly varying functions at infinity: the class of positive, 
measurable £, defined on some neighborhood [A, oo) of infinity, such that 

(2.10) lim l(\x)/l(x) = 1 for all A > 

x — >oo 

(see [BGT1 Chapter 1]). For f 6 K and d 6 (0,1/2), we consider the following 
condition as a standard one for processes with long memory (see |IK21 (A2)]): 

(L(d,£)) {X n } is PND and {c„} and {a n } satisfy, respectively, 

(2.11) c n ~ n- {1 - d) i(n) (n-xx>), 

2.12 a n ~n- {1+d > — K —t (n-»oo). 

i[n) it 

The condition (L(d,£)) implies 
(2.13) 7 „ - n- (1 - 2d) £(n) 2 B(d, 1 - 2d) (n -> oo) 

(see jIK2| (2.22)]), whence {7™} ^ J 1 , where _B(-, •) denotes the beta integral, i.e., 

B{p,q)= [ t*-\l-ty- 1 dt= T( f )I } q) (p,q>0). 
Jo r (P + <?) 

Here is a result of the type (d/n) for processes with long memory. 



Theorem 2.3. For £ £ TZq and d £ (0,1/2), (L(d,£)) implies the asymptotic 
behaviour (d/n) of the PACF. 



For example, the FARIMA(p, d, q) model with < d < 1/2, which is regarded 
as a standard parametric model with long memory and which we consider below, 
satisfies (L(d, £)) for some constant function £ (see Kokoszka and Taqqu |KT[ Corol- 
lary 3.1]), whence, by this theorem, its PACF has the asymptotic behaviour (d/n). 
We see another class satisfying (L(d, £)) in §33 We can write the property (d/n) as 
d = linin^oo na n , suggesting how to estimate the parameter d, which is important 
in a process with long memory. See [IK 11 §5] for numerical calculation. 

We consider the FARIMA. For d £ (-1/2, 1/2) and p,geNU {0}, a stationary 
process {X„} is said to be a (causal and invertible) fractional ARIMA(p, d, q) (or 
FARIMA(p, d, q)) process if it has a spectral density A(-) of the form 

where $(z) and Q(z) are polynomials with real coefficients of degrees p, q, respec- 
tively, satisfying the following condition: 

$(z) and Q(z) have no common zeros, and have no zeros 

(2 15) 

in the closed unit disk {z £ C : \z\ < 1}. 

The fractional ARIMA model was introduced independently by Granger and Joyeux 
[GJ] and Hosking [Ho]. See §2.5] and BD, §13.2] for textbook treatments 
and [KTj for a formulation in terms of the backward shift operator B. If d £ 
(—1/2, l/2)\{0}, then the MA coefficient c„, AR coefficients a n and autocovariance 
function {7„} of the FARIMA (p, d, q) process {X n } satisfy 

(2.16) c „^ n -(i-«)_^L („-oo), 

/ 01 ^ -(i+d) T ( d ) dsin(Trd) 

(2.17) a n ~ n y ^ '—— (n^oo), 

r918 s - ( i-2d) (^i) 2 r(l-2d)sin(rrd) 

(2.18) 7„ ~ n y > (n->cxD), 

TT 

where 

(2.19) K x := 0(1)/$(1) 

(see [KTl Corollary 3.1] and [El §3]). In particular, if < d < 1/2, then {X n } 
has long memory. On the other hand, if d = 0, then {A„} reduces to the ordinary 
ARMA(p, q) process, and each of c„, a n and j n decays exponentially fast as n — > oo 
(see [BDl Chapter 3] and §7 below). 

Theorems liTCI and l2~3l cover FARIMA with d £ (0,1/2) but not the case d £ 
(-1/2,0). However, the FARIMA(0, d, 0) with d £ (-1/2,1/2) has the PACF 
given by 

(2.20) «» = ^-J (n = l,2,...) 

n — d 

(see |Hol Theorem 1(f)] as well as |BD1 (13.2.10)]), which suggests that (d/n) may 
also hold even if d £ (—1/2,0), and this is actually the case as we show below. 
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For FARIMA with -1/2 < d < 0, we define 

= j-a (n = 0), 

|a n _!-a„ (ra= 1,2, ...). 

and 

oo 

i/) n :=- ^2 c k (n = 0, 1, . . . ). 

fc=n+l 

Notice that <fi n here corresponds to —4> n in [IKlj . We define g G (1/2, 1) by 

q:=l + d. 

Then, by [IK 11 Lemma 4.1] and |KT[ Corollary 3.1] (see also [HI Lemma 2.1]), we 
have 

(2.21) ^ n -(l-«)ZL {n ^^ h 

(2.22) ^^- n -^)m.^A 

Al 7T 

where K\ is as in (|2.19p . We define 

/3-(n) := }^i/j v 4> v+n+ i (n = 0, 1, ...). 

7J = 

Notice that /3_ (n) corresponds to —f3(n) in [IKlj . We define, for n = 0, 1, . . . , 
di(ra) = f3-(n), 

OO 

= ^2 P-( m i + n)f3-(m\ + n), 

mi=0 

and, for fc = 3, 4, . . . , 

oo oo 

<4(n) = ^-(mfe-i+n) /3_(mk_i + mk-i + ri) 

m fc _i=0 m t ._2=0 
oo oo 

•■• /3_(m 3 + m 2 + n) /?_ (m 2 + mi + n)/3_ (mi + n), 

7712—0 7711—0 

the sums converging absolutely (see |IK2[ Theorem 3.3]). 

The representation of the PACF of FARIMA with d G (-1/2, 0) is given by the 
next theorem. 

Theorem 2.4. Let p, q G N U {0} and d G (—1/2, 0), and let {X n } be a fractional 
ARIMA (p, d, q) process. Then, for n = 1,2,..., the representations (|2.6[H(|2.8[) of 
U n , V n and a n hold with all the sums converging absolutely. 

Here is the result of the type (d/n) for FARIMA. 

Theorem 2.5. Let p, q G N U {0} and d G (-1/2, 1/2) \ {0}, and let {X n } be a 
fractional ARIMA (p,d,q) process. Then the PACF has the asymptotics (d/n). 



This last theorem as well as Theorem 12.31 is an improvement of earlier work 
[l2l l!3l HKlj for long-memory or FARIMA processes, asserting that 

(2.23) |a„| ~ \d\/n (ti-kx). 



Notice that while the earlier result cannot distinguish between the d and —d cases 
(that is, between positive and negative differencing), Theorems 12.31 and 12.51 can. In 
[El H3l IIK1| , the asymptotic behaviour of mean-squared prediction error of the type 

(2.24) 6{n) ~ d 2 /n (n -> 00) 

was first derived and then used in Tauberian arguments to prove (|2.23l) . where 

^^ "^^""^r^ 1 " 3 (n = l,2,..)- 

Il^-oo.o] Xl II 

The proofs of Theorems 12.31 and 12. 5| which are based on the representation of the 
PACF, are more direct and much simpler than those of the earlier result. 



3. Inner products of prediction errors 

In this section, we derive some expansions of V n and U n that we need to prove 
the representation of the PACF. The key is to extend (HI Theorem 4.1] properly. 
For n, k £ N, we define the orthogonal projection operator P* by 



(3.1) P* 



P(-oo,n-i\ (A; = 1,3,5,...), 
P [hoo) {k = 2,4,6,...). 



It should be noticed that {P„ : k = 1, 2, . . . } is merely an alternating sequence of 
projection operators, first to the subspace ■H(_oo,n-i]! then to Hu iCO \, and so on. 

Theorem 3.1. Let Y ll Y 2 G P. We assume t/ia£ {A„} is CND. 
(1) FFe /iai>e 

(y 1 ,y 2 ) = ((p 1 1 ) i r 1 ,(p 1 1 ) i y 2 ) 

(3.2) 



k=l 



^pk+l^pk . . . p i Yi) (pfc+i)ipfe . . . piy 2 ) 



(2) We have, for n = 2,3, ... , 

(Plt-a-l^Pin-l]^) = {(P^Y^iP^Y,) 



+ E (i P n + 1 ) ±P n ■ ■ ■ PnYl, (P* + Y P% ' ■ > Pfa) ■ 
fc=l 

If we put Yi = Y2 in Theorem 13. If 2). then it reduces to [I2j Theorem 4.1]. 
Proof. (1) The orthogonal decompositions 

H = H t-oo,Q] © #(-oo,0]i 
# = ff [l,oo) © ^[l,oo) 

of imply the orthogonal decompositions 

(3-4) ^ = ^(-oo,0]© P (-oc,0], 

(3-5) Ih = P[too) © P[i,°°) 
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of the identity map Ih, respectively. Repeated use of (|3.4[) and (|3.5|) yields, for 
m = 2, 3, . . . , 

(Y 1 ,Y 2 )=((P}) ± Y 1 ,(P£) ± Y 2 ) 

m — 1 

+ E ((Pf+Y Pi" • • ■ PlY u (P? + YPi ■ ■ ■ Pfc) + R?, 

fe=l 

where R 7 ? := (Pf ■ • • P^Y^P™ ■ ■ ■ P?Y 2 ). Since (CND) and von Neumann's alter- 
nating projection theorem (see [FJ Theorem 9.20]) imply 

s-lim Pf 1 • • • Pi = 0, 



we have lim m ^oo P™ = 0, whence Q3.2p . 

(2) For n = 2, 3, . . . , we have the orthogonal decompositions 



( — oo,n — 1] 
oo) 



#[1,71-1] = ff [to°) © ^[1 

of -ff[Y„_!], which in turn imply the orthogonal decompositions 

(3-6) P[l,n-l] = -P(-oo : ri-l] © P\l,n-l]P(-oo,n-l], 

(3-7) ^[1,71-1] = ^"[l.oc) © P[l,n~l]P[l,oo) 



of P[i n _i], respectively. Using (J3T6J) and (|3.7p repeatedly, we find that, for m = 

2,3,.;., 

(^[t" - 1] Yl ■■ P [l, n - 1] ^2 ) = ( (P r > ) 1 Yi , (P^ ) - 1 Y 2 ) 

771—1 

+ E (( P n +1 )^Pn ■ ■ ■ PnYu (P^V ^ ' ' ' ^) + iC, 
fc=l 

where P™ := (ift^J™ ■ • • i^i, P^-i]^ ' ' ' ^a)- From (IPF) implied by 
(CND) (see |IK2[ Theorem 2.3]) and the alternating projection theorem, we get 

s-hm Pr---P^ = P[i,n-l], 

m — *-oo 

whence 

Iim IIP^-I]^ ■ • • PfrW = ||P[tn-l]^l,n-l]li|| =0 (i = 1, 2). 

7T7 *rv"l L I J L I J L J 



Thus lim™^ R™ = 0, so that (O follows. □ 

Remark. If is CND, then by the same arguments as above we see that 

P[l,n-X] = Cn) + [Pn) P n + C^n) P n P n + ' ' ' ■ 
Assuming (PND), we define 

m 

b T : = °k a J+m-k (m,j GNU {0}). 
fc=0 

Notice that bj 1 here is equal to that in |IK1| but it corresponds to b™^] 1 in [I2j [13] . 

Recall U n and V n from §2. Here are their representations in terms of the AR 
and MA coefficients. 
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Theorem 3.2. We assume (PND) and X!^o \ an \ < 00 • Then, for n — 1, 2, ... , 

OG OO 

(3.8) U n = (c ) 2 y^^y^^d k (n,p)d k ~i(n,p), 

fc=l p=0 



OO OO 



(3.9) K = (c ) 2 ^^4(n,p) 2 , 
where, for n £ N and peNU {0}, do{n,p) := 5 P 0; 

OO 

(3.10) := ^ a n+mi+p c miJ 

mi=0 

and, for k — 2,3, ... , 

OO OO OO OO 

(3.11) d k (n,p):= ^ On+m*_ 1 X! C+m fc _ 2 ' ' ' X] X] Cfp-H; c ^ 

nik-i— mfc— 2= mi— ^—0 

aH i/ie swms converging absolutely. 

Proof. (Compare the proof of [lU Theorem 4.5].) Notice that {X n } satisfies (IPF) 
(see [12], Proposition 4.2 and Theorem 3.1), whence (CND) (see [IK 2] . Theorem 
2.3). Hence, it follows from Theorem 13 . 1 1 that . for n — 1, 2, . . . , 

U n = ({P^PlX n , (P^Xo) 

(3.12) 



fc=2 

OO 

(3.13) V n = \\(P^) X X n f + E IK^J^Pn* • • ■ P^nf. 



fe=l 



Let neN. Suppose that k is even and > 2. By [El Theorem 4.4], we have, for 
n = 1,2, . . . and m — 0,1, ... , 

OO 

-P(-oo,n-l]^m+n = ^ C+j^-j ( mod #[l,n-l] if 71 > 2), 

3=0 

OO 

-P[l,oo)^-m = X C+i^J+n ( mod if " > 2 ), 

whence 



pk ply _ \ " \ ^ .mfc-i 

' ' ' r n yv n — H) / J «n+m fc _i / y u n+m k _ 2 

m fc _i=0 m fc _ 2 =0 

OO OO 

■ • • X X C+mo^mo+t. (mod H[i,„-i] if n > 2). 

mi— mo— 

Since we restrict to (PND), {X n } has no deterministic component in the Wold 
decomposition and it permits the moving- average representation (MA), where the 
orthonormal system {£j : j e Z} of satisfies 

H(-oo,m] = #(-oo,m](0 ( m G Z) 
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with if(_oo,m](£) being the closed subspace of H spanned by {£j : — oo < j < m} 
(see [R31 Chapter II], [BDj §5.7]). Since 

m 

-P(-oo,n-l]^TO+« = Cm-jtij+n (m = 0, 1, . . .), 

3=0 

we have 

oo oo 

/pfc+l\±pfe ply _„ V /i ^"fc-i 
l^Ti / ' ' ' r n A n — K) / J «n+m fc _i / J u n+m k _ 2 

m fc _i=0 m fc _ 2 =0 

oo oo mo 

^n+mi ^n+mg c m a -j£,j+n, 

nii—Q mo— j— 



so that 

Arguing similarly, 



c d k (n,p) (p = 0,l,...), 

(p = -l,-2,.. 



/t /pWUpk p2y \ jcorf fe _i(n,p) (p = 0,l,...), 

(£ p+n ,(P„ ) P„...P B X )-| (p=-l,-2,...). 

Thus, from the Parseval equality, we get 

^ 3 ^ = ( c o) 2 y^fc(rc,p)^fc-i(rc,p)> 

oo 

(3-15) ||(P n fe + 1 )^---Pn^l| 2 = (co) 2 E^^P) 2 ' 

p=0 

Similarly, we have (|3.14|) and (|3 . 1 5[) for k odd, and also 

oo 

(3.16) ((P n 2 ) x P„ 1 X„, (P 2 ) X X ) = (c ) 2 di(n,0) = (c ) 2 £ ^(n^do^p), 

oo 

(3-17) IKP^AJ 2 = (c ) 2 = ( Co ) 2 ^>(n,p) 2 . 

p=0 

The assertions (|3 . 8[) and (|3.9[) now follow if we substitute (j3TT4|) and (f3TT6|) into 
(ESP) , and (BHD and (|3~T7)) into (j3~T3]) . □ 

We write to indicate that the sum does not necessarily converge absolutely, 

i.e., Y^k=m := um M-»oc Sfelm- We nee d the next variant of Theorem 13.21 when we 
consider the fractional ARIMA(p, d, q) processes with — 1/2 < d < 0. 

Theorem 3.3. We assume (PND). Then the representations and $3.9\ still 

hold if all the summations ^2°° in <\3. 101 and <\3. 1 -?[) are replaced by an d */ 

X)o° l a ™l < 00 *s replaced by the two conditions X)o° l c «l < 00 So° l a «| 2 < 00 ■ 
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Proof. By [12 , Proposition 4.2 and Theorem 3.1] and |IK2[ Theorem 2.3], the con- 
ditions (PND) and {a n } € I 2 imply (IPF), whence (CND). Moreover, by [PKT1 
Proposition 2.1], we have, for n € N and m € N U {0}, 

oo — 

P(-ao,n-l] X m+n = ^ b n+j X -j ( mod H [l,n-l] if n > 2 )> 

3=0 

OG — 

P[l,ao)X-m = K+j X J+n (mod i^i.n-i] if Tl > 2). 

Using these equalities, we can prove the theorem as in the proof of Theorem 13.21 
We omit the details. □ 

4. Proof of Theorem 12.11 



First we give some necessary and sufficient conditions for (BC). Recall that the 
spectral measure of a stationary process is assumed to have infinite support. 

Theorem 4.1. For a stationary process {X n }, the following conditions are equiv- 
alent: 

(1) {X n } is PND and satisfies both |a„| < oo and l c «l < °°> 

(2) has a positive continuous spectral density and satisfies X)o° l c ™l < °°> 

(3) {^n} has a positive continuous spectral density and satisfies X)o° l a «l < °°i 

(4) {X n } satisfies (BC); 

(5) {-Xn} has summable PACF: X^o° \ a n\ < oo. 

Proof. Notice that if {X n } has a positive continuous spectral density A(-) on 
[-7T, tt], then it is PND since | log A{0)\d0 < oo holds. 

Suppose (1). We write D{e lS ) for the nontangential limit of D(z), i.e., 

D{e lB ) = lim £>(re l9 ) = V °° c n e m0 {-tt < < tt). 

Since {c n } G Z 1 implies the continuity of D(e ie ), the spectral density A(0) is also 
continuous by the equality A(6>) = 2n\D{e ie )\ 2 . Letting r — > 1 — in 

(EHo^e-) (^^e«) = -1 < < vr), 

we obtain 

, c ^ m °) (E7=o a " em9 ) = _1 (_7r - * - 



This implies that D(e l6 ), whence A(0), has no zeros on [— tt,tt}. Thus A(-) is 
positive, whence (2) and (3) follow. 

Suppose (3). In the same way as above, we have 



-My" a n e in<>2 {-7T<9<ii). 



A(0) 2ir 

This implies X^^Lo a n^ m9 7^ for every 9 S [— 7T, 7r]. By Wiener's theorem for 
absolutely convergent Fourier series (cf. Lemma 11.6 in [Ru] ) . we obtain {c„} € Z 1 
(cf. Berk [Berk], page 493). Thus (1) follows. The proof of the implication (2) =>■ 
(1) is similar. 
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By (|2.ip . (2) implies (4). Conversely, we assume (4). Then we have {a n } £ I 1 , 
whence (3), by the arguments in Baxter |Ba2j . pp. 139-140, which involve the 
Wiener-Levy theorem. 

The equivalence between (4) and (5) is Baxter's theorem ([Bal, Ba2]; see also 
|Si3[ Chapter 5]). This completes the proof. □ 

We put 

oo 

B{n) :=Y,\cva n +v\ (neNU{0». 

v=0 

For n, k, u, v £ N U {0}, we define D k {n, u, v) recursively by 
r D (n,u,v) := S uv , 
Dk+i(n, u,v) := } Bin + v + w)Dk{n,u,w) 

v z — d w— 

(see [IK 2 [ §2.3]). We have, for example, 



oo oo 



D 3 (n, u, v) = \_. B{n + v + vi)B(n + v\ + v 2 )B(n + v 2 +u). 
Proposition 4.2. We assume either (BC) or (0(l/n)). Then, for k,n,v £ NU{0}, 

oo oo 

Dk(n, u, v) < oo and Dk{n, u, v) 2 < oo, 

u=0 u=0 

respectively. In particular, we have D).(n, u, v) < oo for k,n,u,v £ N U {0}. 

In view of Theorem 14.11 we can prove Proposition 14.21 in the same way as that 
of [IK21 Lemma 2.7], whence we omit it. 

Recall 0(n) from (*) and dk(n,p) from Theorem 13.21 

Proposition 4.3. We assume either (BC) or (0(l/n)). Then we have, for n £ N 
andp£ NU{0}, 

(4.1) di{n,p) = P(n+p), 

OO 

(4.2) <h{n,p)= ^2 /3(mi +n)/3(mi +n + p), 

mi— 

and, for k = 3, 4, . . . ; 

oo oo 

d k (n,p)= 22 P(mk-i+n) 2J P{ m k-i + rrik-2 + n) 

,. „, m fe _i=0 m fc _ 2 =0 

(4.3) 

v 7 oo oo 

••• /3(to 3 + to 2 + ?i) /3(to 2 + mi + n)/3(mi + n + p), 

ni2- mi— 

£/ie swms converging absolutely. 



Proof. By Proposition ^. 2[ we can use the Fubini-Tonelli theorem to exchange the 
order of sums in (|3.11[) , and we get (|4.2p and (|4.3[) as in the proof of [HI Theorem 
4.6]. □ 
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Proposition 4.4. We assume either (BC) or (0(l/n)). Then, for i, j £ N, 

oo 

(4.4) ^d4n,p)d.,(n,p) = d i+i (n,0) (n = 1,2,...). 

Proof. For simplicity, we give details for the case i = j = 4 only. The general case 
can be treated in the same way. From Proposition 14.31 we have, for n = 1,2, . . . 
and p = 0, 1, . . . , 

oo 

Eoo ^ — ^ 
/?(mi+n) } P(m 1 +m2 + n) 

It r\ TOl=0 * ' 

(4.5) m 2 =0 

Eoo 
/3(m 2 + to 3 + n)/3(m 3 + jj + ?i). 
m 3 =0 

By Proposition ^. 21 and the Fubini theorem, 

Eoo ^ — T oo 
/3(m 3 +p + n)) f3(m 2 + m 3 + n) 

(4.6) -r° ma=0 

> /3(wi + m2 + n)P(mi + n). 

Writing (7777,7776,777,5) for (mi, 7712,777,3) in (|4.5|) . we get 

Eoo ^ — ^oo 
/3(m 7 + n)> /?(m 6 + my + n) 

> /3(?ri5 + + ri)(3(p + m 5 + n). 

^— '771.5=0 

From (|4"1)|) , <|4~?1) and the Fubini theorem, 

Eoo ^ — ^00 
d,4(n,p)d4(n,p) = > c?4(n, 7774)^4(71, 777,4) 

P=0 ^ — '7714—0 

Eoo — ^oo ^ — ^00 
n V n /?( m 7 + ™)> /3(m 6 + TO 7 + n) 

rri4— l z — 'm7—0 ^ — 'me— 

f3(m$ + m 6 + n)/3(m4 + m 5 + nH 

m 5 — J 

x ^ > /3(m 3 + m 4 + n) > /3(m 2 + m 3 + n) 

l> — 'm 3 =0 — 'rn 2 — 

EOO 1 
/3(mi + m 2 4- n)f3(mi + n) f , 
mi— J 

which is equal to 

oo 

Eoo ^ — ^oo ^ — ^ 
(3{m 1 + n) > /3(m 6 + m7 + n) } /3(m 5 4- m 6 + n) 

nir—0 £ — 'me— * — ' 

m 5 =0 

Eoo ^ — T oo ^ — ^oo 
/?(m 4 + m 5 -h n) > /?(?^3 + ™4 + n) > /?(m 2 + m 3 + n) 

m4— ^ — ^3-0 ^ — 'm2— 

Eoo 
/?(mi + m 2 + n)/3(mi + n) 
mi— 

= dg(n, 0). 

Thus the desired result for z = j = 4 follows. □ 
Proof of Theorem \2.1\ By Proposition 14.31 we see that 

4(77) = d k (n,0) (fc,neN). 



From this, Proposition 14.41 and Theorem 13.21 the theorem follows. □ 

is 



5. Proofs of Theorems I2.3l - [2~5l 

Proposition 5.1. For d € (0, 1/2) and I 6 TZq, we assume (L(d,£)). 

(1) It holds that 

sin(Trd) _ x 
/3„ ~ n (n -> oo). 

(2) T/ie condition (0(l/n)) holds. More precisely, we have 

^ sin(Trd) _ x 

> CuOn+u ~ n (n — > oo). 

' — ' 7T 

(3) for s > and u > 0, it ZioZds i/iai 

/8( [ns] + [nu] + n) ~ v f— n (n -> oo). 

7T(S + U + 1) 

(4) for r G (l,oo), f/iere exists N\ G N suc/i that 

(5.1) |/3([ns] + [ot] + n)\ < — > — ^-n" 1 (s > 0, u > 0, rc > AM. 

7r(s + u+l) 

Proof. The assertions (1) and (2) follow from [Til Proposition 4.3]. Since we have 
[ns] + [nu] + n ~ n(s + tt + 1) as n — > oo, (3) follows from (1). Let r G (l,oo). 
Then n/ {[ns] + [nu] + n) — > l/(s + w + 1) as n — > oo, uniformly in s > and u > 
(cf. |BGT[ Theorem 1.5.2]), so that there exists N 2 G N such that 

1 r 1 / 2 

< -7 r (s > 0, u > 0, n > iV 2 ), 



([ns] + [nu] + n) n(s + u + 1) 
while, from (1), there exists N 3 G N such that 

r 1 / 2 sin(7rd) 

A, < — (n>N 3 ). 

7rn 

If we put Ni := max(7V 2 , N 3 ), then, for s > 0, u > 0, n > iVj., we have 



r 1 / 2 sin(7rd) r sin(7rd) 



|/3([n.s] + [nu] + n)| < — - — — - < 



-n 



-l 



7r([ns] + [nu] + n) 7r(s + u+ 1) 
Thus (4) follows. □ 

Recall dk(n) from (|2.3p - (|2.5p . For k = 1, 2, . . . , we define the constant r^, which 
is equal to / fe (0) in [IK2], by 

1 1 f°° ds x 

and, for fc = 3, 4, . . . , 



(«1 + 1)(«1 + 1) 7T 2 ' 



1 f°° f°° 1 ( k 2 - 1 1 

7 *=5f/ d Sk ^--. d S1 m 



(s fc _i + 1) I ^ (s m+ i + s TO + 1) J (si + 1) ' 

Proposition 5.2. For d E (0,1/2) and££lZo, we assume (L(d, £)). 

(1) for r G (1, oo) and N± G N satisfying |5.jp . 

(5.2) |d fc (n)| < n- 1 { r sin(7rd)} fc r fc (w > 0, fc G N, n > A^). 

(2) for fe G N and it > 0, 

(5.3) dfc(n) ~ n _1 {sin(7rd)} fe Tfe (n — * oo). 
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Proof. Let k > 3 and write 

/>oo 

dfc(n) = y ds*;-i • • • / dsif3([s k -i] + n) 

( fc-2 



J| /3([s m+ i] + [s m ] + n) \ X /3([si] + rc) 



v m— 1 



ds k -i--- I dsi/3([ns k -i] + n) 



x | II /3(["- s m+i] + [ns m ] +n)| x /3([nsi] + n). 

Applying Proposition l5.1l and the dominated convergence theorem to this, we obtain 
(15.21) and (15. 3R . The cases k = 1, 2 can be treated in a similar fashion. □ 



Proposition 5.3. For k = 1,2, . . . , we /iaue r k < ir 2 . 

Proof. Let T be the linear bounded operator on £ 2 ((0, oo), c?w) defined by 

,oo 1 

: = / — : — g(v)dv. 
Jo u + v 

Then, by Hilbert's theorem (cf. |HLP|, Theorems 316 and 317]), the operator norm 
||T|| is equal to ir. Hence, for the inner product (•, •) of £ 2 ((0, oo), du) and f(x) := 
1/(1 + x), we have r k < ir~ k (f, T k ~ 2 f) < tt~ 2 , yielding the proposition. □ 



Proof of Theorem \2.3l To apply the dominated convergence theorem, we choose r > 
1 so that < rsin(Trd) < 1. Then, by PropositionlPl J2kLi r 2 fc-i{r sin(7rcf)} 2 ' c - 1 < 
oo. Hence Proposition 15.21 and the dominated convergence theorem yield 



(5.4) lim n Vd 2fc _i(n) = Vr 2fc _isin 2fe 1 (nd). 

r>. — >r*n ' ' ' * 



n — >oo 

k=l fc=l 



By Lemma 15.41 below, the right-hand side is equal to d. Thus, by Corollary 12. 2[ 
(d/n) follows. □ 

Lemma 5.4. For \x\ < 1, we have J2T=i T 2k-i x : 21 = ir^ 1 arcsinx. 

Proof. (Compare the proof of [El Lemma 6.5].) For < d < 1/2, let {Y n : n e Z} 
be a fractional ARIMA(0, d, 0) process such that E[(Y ) 2 } = T(l - 2d)/r 2 (l - d). 
We denote by c' n , a' n , and a' n the MA and AR coefficients, and PACF of {Y n }, 
respectively. Then we have, for n = 0, 1, . . . , 

, T(n + d) , T(n-d)d 

c ' n ~ r(n + i)r(d)' a " ~ r(n + i)r(i-d) 

(see, e.g., |BD1 §13.2]). We define d' k (n) similarly. Then since {Y n } satisfies 
(L(d,f )) with £' = l/r(d), it follows from JHU) that 

OO OO 

lim nV4fc-i(rc) =Y]T2/ ! -i{sin(7rd)} 2fc - 1 . 

?i — >oo * — » * — » 

fc=l fc=l 
However, since a' n — d/(n — d), Corollary |2.2l gives 



lim n ) d' 2k _i{n) = lim na' n = d. 



fc=l 
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Combining, we obtain T 2 k-i sin 2fc 1 (ird) = d. The lemma follows if we substi- 
tute 7T _1 arcsina; with < x < 1 for d and use analytic continuation. □ 

Remark. From Lemma 15.41 it follows that 
- 1 (2Jfe-2)! 

Proof of Theorem \2.4\ Let {J„} be a fractional ARIMA(p, d, q) process with spec- 
tral density (|2~T4f with (|2~15)) . We assume that —1/2 < d < 0. Then (|2.16p and 
(|2.17p imply {c„} € I 1 and {a n } € i 2 , respectively, so that we can use Theorem 
13.31 Let dk(n,p) be as in Theorem 13. 31 Recall <p n , ip n and /3_(n) from §2. By |IK1( 
Theorem 3.3], we have the same conclusions as those in Proposition 14.31 with [3(n) 
replaced by /3_(n). Notice that, in [IK1, Theorem 3.3], the results are stated for 
n > 2 but we can prove the case n = 1 in the same way. The equality (|4.4[) holds 
in the same way as the proof of Proposition 14.41 Hence the theorem follows from 
Theorem EM □ 



Proof of Theorem \2.5[ If < d < 1/2, then (d/n) follows immediately from Theorem 
[231 We assume that -1/2 < d < 0. Let q := d + 1 G (1/2, 1) as in §2. Then, from 
([2~2"Tj) . |2~22|) and [TQ Proposition 4.3], it follows that 

sin(Trg) _ x 
P-(ri) r~j n (n — > oo). 

Running through the same arguments as those in the proof of Theorem l2.3[ we see 
that 

oo oc 

lim na n = lim n } d 2 k-i(n) = - } T 2 k-i sm 2k ~ 1 (irq) = d. 

n — >oo n — *oo — ' — ' 

k=l k=l 

Thus, again, (d/n) holds. □ 

6. Model with regularly varying autocovariance function 

In this section, we apply the representation of PACF to a stationary process 
{X„} which has regularly varying autocovariance function. We will also assume 
that {X n } is PND and satisfies the following conditions (cf. [I2l §2]): 

(CI) c„ > for all n > 0; 

(C2) { c n} i s eventually decreasing to zero; 

(Al) {a n } is eventually decreasing to zero. 

Notice that (CI) and (Al) imply {a n } G I 1 (see [H Proposition 4.3]). In [E], 
the extra condition 

(A2) {a„ — a„+i} is eventually decreasing to zero 

is also required but we do not need it here. By [Kj Theorem 7.3], {X n } satisfies 
(Cl)-(Al) (and also (A2)) if 

there exists a finite Borel measure a on [0, 1) 

(BP) 



such that 7„ = t^cr(dt) (n G Z). 



This property is called reflection positivity or T-positivity, which originates in quan- 
tum field theory; see, e.g., Osterwalder and Schrader [OS] , Hegerfeldt |Hej and 

18 



Okabe [D] . A prototype of such a process is {X n } with j n = (1 + | n| ) — C 1 — 2d ) ^ 
— oo < d < 1/2, which we consider in the Example below. 

Let £ £ Ho, and choose a positive constant £? so large that £(■) is locally bounded 
on [B,oo) (see jBGTl Corollary 1.4.2]). When we say J £(s)ds/s = oo, it means 
that £(s)ds/s — oo. If so, then we define another slowly varying function I by 

(6.1) tlx) := [ X —ds (x > B) 

Jb s 

(see [BGT1 §1.5.6]). The asymptotic behaviour of £{x) as x — > oo does not depend 
on the choice of B since we have assumed that J £(s)ds/s = oo. 
Here is the result on the asymptotic behaviour of a n . 

Theorem 6.1. Let -oo < d < 1/2 and £ £ K . We assume (PND), (CI), (C2), 
(Al), and 

(6.2) 7 „~n 2d -^(n) (n -> oo). 

(1) IfO<d< 1/2, tfien (ef/n) fcoZds; 

(2) if d — and J°° £(s)ds/s = oo, then 

(6.3) a„~n — = — m— »oo); 
V ' 2*(n) 

(3) if d = with J°° £(s)ds/s < oo or —oo < d < 0, then 

(6.4) a„ - — 55 (rc-»oo). 

This theorem is an improvement of [Ml Theorem 2.1] where only \a n \ is consid- 
ered with additional assumption (A2). 

We need some propositions to prove the theorem above. 

Proposition 6.2. Let £ £ TZq. If f°° £(s)ds/s — oo, then £{n)/£{n) tends to as 
n — ► oo. If J°° £(s)ds/s < oo, then £(n) tends to as n — > oo. 

Proposition 16.21 follows immediately from [BGT1 Proposition 1.5.9a]. 

Proposition 6.3. Let £ £ K and -oo < d < 0. We assume (PND), (CI), (C2), 
(Al), and (TQ|) . 

(1) J/ e? = and J°° £(s)ds/ s — oo, then 

(6.5) c„ - n- 1 £(n){2£{n)}- 1/2 (n ^ oo), 

(6.6) a„ - n" 1 ^(n){2| r (n)}- 3/2 (n -► oo), 



(6.7) f3 n ~ n~ 1 £(n){2£(7i)}- 1 (n 



oo 



(2) If d = wrf/i J°° £(s)ds/s < oo or -oo < d < 0, i/ien 

-1/2 



(6.8) c„ ~ n 2d -H(n) ( n - 

(6.9) a„ ~ n 2d ~^(n) {XT^ 7fc}~ 3/2 (n -> oo), 

(6.10) f3 n ~ n 2 ^ 1 ^) {Y^^y 1 (n oo). 



1!) 



Proof. The assertions (|6.5I) and (|6.6[) follow from [I2l Theorem 5.2]. Using them, 
we obtain flfTT]) (see [El (6.19)]). The assertions (JSTSJ) and follow from [El 

Theorem 5.3]. From them, we get fpTTUl) (see the proof of [HJ Theorem 6.7]). □ 

Proposition 6.4. Let £ e K and -oc < d < 0. We assume (PND), (CI), (C2), 
(Al), and (TQ|) . 

(1) For every R £ (l,oo), there exists N € N such that 



(6.11) 



/3([ns] 4- [nu] + n) 



7? 

<7 tt (s > 0, u > 0, n > N). 



(2) For every r G (0, 1), there exists N S N smc/i i/iai 

(6.12) |/3([ns] + [nu] +n)| < — -n -1 (s > 0, u > 0, n > N). 

7r(s + U + 1) 

Proof. By Proposition ^. 31 and BGT, Theorem 1.5.2], we have 

P([ns] + [nu] + n) /f3(n) (s + u + l) 2d_1 (n -» oo) 
uniformly in s > and u > 0. Since 

(s + u+l) 2 ^ 1 < (s + u + 1)- 1 , 
(1) follows. By Propositions 16.21 and l6.3[ we have 

(6.13) lim nj3 n = 0. 

n — >oo 

This and (1) show (2). □ 

Recall dk(n) from (|2.3p ~ (|2.5p and Tk from §5. 

Proposition 6.5. Let £ e K and -oo < d < 0. We assume (PND), (CI), (C2), 
(Al), and (HH). 

(1) Let r e (0,1) and R E (l,oo). Choose N e N so i/iat 6oi/i ([07]) and 
(fO^jl /io/d. T/ien \d k {n)/P n \ < irRr^n forkeN, n> N. 

(2) For k>2, lim„^oo d k (n)/0 n = 0. 

Proof. In the same way as the proof of (|6.13j) . we see that (0(l/n)) holds. Wc 
assume k > 3; the cases k = 1, 2 can be treated in a similar way. We write 

<4(n) Z" 00 , Z" 00 , /?([ns fc _i] + n) 

ds fe _i ■ • • / dsi- 



x 1 II n P([ ns m+i] + [ns m ] + n) > x n(3{[nsi] + n). 

lm=l J 

From this as well as (|6.11|) and (I6.12| . wc get (1). The assertion (2) follows from 
(|6.1ip - (|6.13[) and the dominated convergence theorem. □ 

Proof of Theorem [6l\ Assume that < d < 1/2. Then, from [12 Theorem 5.1], 
(L(d,£')) holds with t'(n) := [£(n)/B(d,l- 2d)] 1 ' 2 . Hence (d/n) follows immedi- 
ately from Theorem 12.31 

Next, we assume — oo < d < 0. By (Al) and (CI), X^=o \ c v a v+n\ = Pn if n is 
large enough. Hence from (|6 . T[) . (|6.10[) and Proposition 16.21 (0(l/n)) holds. By 
Proposition 16.51 and the dominated convergence theorem, we have 

lim S£i<fa*-i(") =1+ Um y^ x(n) =1 
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Therefore, by Corollary O we see fllTTDj) . Thus (2) and (3) follow from $£7} and 
(|6.10p . respectively. □ 



Example. Let — oo < d < 1/2, and let {J n } be a stationary process with auto- 
covariance function of the form 7 „ = (1 + \n\)-^- 2d \ Then {X n } satisfies (RP) 
(cf. [H Example in §7]). Let {a n } be the PACF of {!„}. Applying Theorem O 
to {X„}, we get the following result: 

(1) if < cl < 1/2, then we have (d/n). 

(2) if d = 0, then a n ~ l/(2nlogn) asm oo. 

(3) if -oo < d < 0, then a„ ~ n 2 ^ 1 • [2((1 - 2d) - l]" 1 as n ^ oo. 

Here £(s) is the Riemann zeta function. 



Remarks. 1. Recall by (2.3) that /?„ is the first term on the right of (|2.9j) . By the 
arguments above, we see that, for the processes treated in Theorem 16. 1[ 



(6.14) lim ^ = ™ (0«*<l/2), 

/?« (l (-OO<d<0). 

We raise, and leave open, the question of how generally this happens. 
2. We note that in Theorems 12.31 l2~5l and HO we have also 



7r> / s 

2^ fc= _„7fc 

(see [I2j §2 and §6] and [I3l §5] for the proofs). It would be interesting to know how 
generally this relation holds. 



7. ARMA PROCESSES 

In this section, we consider the fractional ARIMA(p, 0, q) processes, that is, the 
ARMA(p, q) processes. Let p,ijeNU {0}, and let $(z) and <d(z) be polynomials 
with real coefficients of degrees p, q, respectively, satisfying (|2.15p . Let {X n } be an 
ARMA(p, q) process with spectral density 

1 \Q(e ie )\ 2 

a <"» = siw <-"<"<"■ 

We put R := if q = and 

R := max(l/|ui|, . . . , l/|tt g |) if q > 1, 

where u\,...,u q are the (complex) zeros of 0(z): 

Q{z) = const, x [z — tii) • • • (z — u q ). 

From the assumption (12.151) . we see that \uu\ > 1 for k = 1, . . . , q, whence R € [0, 1). 

Let {a n } be the PACF of the ARMA(p, q) process {X„}. The next theorem 
implies that a n decays exponentially as n — > oo. 

Theorem 7.1. For every r > R, we have 

(7.1) a n = 0(r n ) (n -> oo). 

In particular, a n decays exponentially fast as n — ► oo. 
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Proof. The Szego function D(z) of {X n } is given by D(z) = Q(z)/$(z) for \z\ < 1. 
Hence — $(z)/0(z) = a n z n , so that, for every r > R, 

a n = 0(r n ) (n — > oo). 

Treating -D(z) = 6(z)/$(z) similarly we see that c„ also decays exponentially as 
n — > oo, in particular, {c„} G Z 1 . Therefore, we see that, for every r > R, 

n = O(r n ) (n->oo). 

The assertion (|7.1|) follows easily from this and Theorem 12. U Since r can be chosen 
so that R < r < 1, (|7.1| implies exponential decay of a n . □ 
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